draw the line at
Refuse to go any further than, as in
I draw the line at giving them more money
. This expression alludes to a line drawn at a stopping point of some kind.
[
Late 1700s
]